Click any tag below to further narrow down your results
Links
AirLLM is a framework that streams model layers from disk one at a time during inference, letting you run massive language models like DeepSeek-V3 (671B parameters) on single consumer GPUs without quantization or distillation. It also supports fine-tuning huge models on small VRAM by keeping only adapters in memory while streaming frozen weights.
- Runs a 671B parameter model on ~12GB VRAM and 125B models on ~6GB by keeping only one decoder layer on GPU at a time, with the rest streamed from disk
- Works with virtually every major open-source model family (Llama, Qwen, DeepSeek, Mistral, Gemma, etc.) through a single `AutoModel.from_pretrained()` call with no special configuration
- Supports optional 4-bit/8-bit weight quantization for up to 3x speedup, and fine-tuning of 125B models under 6GB VRAM by streaming base weights while keeping adapters resident
Google announced Gemini 3.8 Flash, its third Flash variant release in six weeks, with a standard version and a specialized Cyber version for security work. The company is offering introductory pricing through year-end but shows no sign of releasing the promised Gemini 3.5 Pro.
- Google is shipping Flash models at an accelerating pace (three releases in six weeks) while the higher-tier Pro model remains stuck at early 2026 versions
- Gemini 3.8 Flash comes in two flavors: a general "workhorse" model and Gemini 3.8 Flash Cyber, tuned specifically for vulnerability detection
- Introductory pricing is $0.75/$3.75 per million input/output tokens (dropping to $1.50/$7.50 after year-end), matching aggressive price cuts from competitors to retain customer adoption
Meta released Muse Spark 1.3, its most powerful AI model to date, which developers can access Wednesday. The company says it's narrowing the gap with leading competitors like OpenAI and Google.
- Developers get paid access to Muse Spark 1.3 starting Wednesday
- Meta plans to integrate the model into Instagram, Facebook, and Meta AI
- Meta's chief AI officer claims the model's capabilities are now closer to top competitors
In a memo to investors, OpenAI says it plans to deploy 30 gigawatts of compute power by 2030, versus Anthropic’s expected 7–8 gigawatts by end of 2027, labeling its rival “compute constrained.” The note underscores OpenAI’s infrastructure edge, compounding efficiency gains, and race for dominance ahead of both companies’ potential IPOs.
- OpenAI's investor memo claims it will hit 30 gigawatts of compute by 2030, versus Anthropic's projected 7-8 gigawatts by end of 2027, calling Anthropic "compute constrained"
- OpenAI frames its infrastructure scale as creating a "compounding advantage" — lower cost per token driving more users, revenue, and further compute investment
- Anthropic pushed back by pointing to a new compute deal with Google and Broadcom, with its CFO calling it the company's "most significant compute commitment to date"
- Both companies are valued in the trillions and are considering IPOs this year, with Anthropic also just launching a cybersecurity-focused model ("Project Glasswing")
Google has launched its powerful Gemini AI model, which has outperformed competitors, including OpenAI's ChatGPT, to become the leading AI chatbot. The company's extensive investment in research and hardware development has enabled it to protect its search business amidst the growing popularity of chatbots.
- Google's Gemini model has overtaken ChatGPT to become the top-ranked AI chatbot
- Years of heavy investment in in-house AI research and custom hardware (TPUs) let Google catch up after appearing to lag OpenAI
- That infrastructure edge is also helping Google defend its core search business against the threat posed by chatbots